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Abstract 



The Logo computer programming language has been described 
as an environment in which children will develop problem solving 
skills. Unfortunately, much of the research devoted to Logo and 
problem solving has not discovered such a connection, but a 
careful reading of the literature suggests that direct instruction and 
mediated Logo programming practice can result in the acquisition 
and transfer of certain problem solving abilities. The research 
reported in this paper was designed to test such hypothesis. In 
particular, it was concerned with differentiating between 
interventions combining direct instruction and mediated practice 
and discovery learning approaches, and with assessing the 
importance of programming within that model. Results reveal that 
the model can indeed support the acquisition and transfer of four 
problem solving strategies - subgoals formation, forward 
chaining, systematic trial and error, and analogy - whereas 
neither discovery learning in a Logo environment nor direct 
instruction with concrete manipulatives practice can. Indications 
are that the model can support the teaching and learning of 
alternative representation strategies as well. The findings support 
claims for the efficacy of Logo as medium conducive to the 
. teaching and learning of problem solving, and argue for the use of 
knowledge-based instructional design and computing 
environments In the creation of problem solving Interventions. 



"Stated most simply, my conjecture is that the computer can concretize 
(and personalize) the formal. Seen in this light, It is not just another 
powerful educational tool. It is unique in providing us with the means for 
addressing what Piaget and many others see as the obstacle which is 
overcome in the passage form child to adult thinking. I believe that it can 
allow us to shift the boundary separating concrete and formal." 

- Seymour Papert (1980, 21) 

Seymour Papert maintains that computers are a truly revolutionary educational 
medium because they support "transitional objects to think with," computer representations 
of abstract ideas that can bo manipulated in seemingly concrete ways to help bridge the 
gap between concrete and formal thought He further argues that this transition will take 
place automatically and painlessly when students are provided with well-structured 
computer environments rich in such computer manipulative, environments such as the one 
he himself designed, the programming language Logo. 

At least as it concerns Logo and the teaching and learning of problem solving, the 
literature reports no such automatic acquisition of problem solving skills. Indeed, multiple 
studies have reported no significant increases whatsoever in problem solving abilities 
among students involved in Logo programming (Papert, Watt, diSessa, & Weir, 1979; Pea & 
Kuriand, 1964, 1967; Leron, 1966; Salomon & Perkins, 1967; Johanson, 1968). Indications 
are, however, that problem solving skills may be enhanced through direct instruction and 
mediated practice in Logo programming environments (Gorman & Bourne, 1963; Clements 
& Quito, 1984; dements, 1967; Carver, 1967; Lehrer & Randle, 1987; Thompson & Wang, 
1968). Indeed, our own pilot researc h found that students' scores on measures of five 
problem solving strategies - suogoals formation, forward chaining, systematic trial and 
error, alternative representation, and analogy - were significantly increased following an 
instructional intervention that combined direct problem solving Instruction with mediated 
practice in a Logo programming environment (Swan & Black, 1968). 

The research reported in this paper was concerned with validating the success of 
that instructional model with respect to Paperfs claims for Logo; in particular, with 
differentiating between that model and a discovery learning approach, and with assessing 
the importance of computer manipulative* within it Two research questions were 



1 . Is explicit instruction and mediated practice in particular problem solving 
strategies superior to discovery learning for supporting the acquisition and 
transfer of problem solving strategies from within Logo programming 
environments? 

2. Is the Logo programming environment particularly supportive of the 
acquisition and transfer of problem solving skills? 

Problem SoMng Strategies 

A number of distinct problem solving strategies can be distinguished from general 
problem solving behaviors ( Newell & Simon, 1972; WicWegren, 1974). Certain of these 
seem more applicable to programming problems in general, children's programming in 
particular (Clements & Quito, 1984; Lawler, 1986; Clement, Kuriand, Mawby & Pea, 1966). 
The research reported in this paper was concerned with the teaching and learning of five 
such strategies - subgoeis formation, forward chaining, systematic trial and error, 
alternative representation, and analogy. General definitions and explicit descriptions of 
each of these follow. Strategy descriptions are based on an extended version of Potya's 
(1973) description of general problem solving. They break . the problem solving process 
into four parts- problem daflntton, specifying the goal and Initial state of a problem, plan 
development and ImpiamentaJon, developing a plan and Implementing a particular 
strategy, evaluation, checking to see that domain operators and general strategies have 
been a>rrectty applied, and recursion, reapplying a strategy at a variety of levels. 

auhaoHUpuMihD 

Subgoals formation refers to breaking a single difficult problem into two or more 
simpler problems. Subgoals formation might thus be seen as the defining of a problem 
space. Even when no obviously solvable subgoals can be found, breaking a problem into 
its constituent parts makes Its solution less formidable, more manageable, and less 
susceptible to errors. Subgoals formation can be described by the following four steps: 

1. Problem definition. Specify the problem. 

2. Subdivision. Examine the problem specification to see where it can be 
broken into smaller, self-contained problems. Specify these and their 
connections to the larger problem. 



3. Evaluation. Test the subproblems generated for grain size and further 
decomposition. If the subproblems are manageable or cannot be further 
decomposed, solve them. Recombine these partial solutions into the total 
solution using the connections specified In step 2. 

4. Recursion. Otherwise, repeat the second and thirt jteps for each of the 
subproblems generated. Continue the process until no more smaller 
problems can be generated for any of the subproblems. 

While subgoals formation might seem an obvious strategy to adults, it is not at all 
obvious to many children (Carver & Klahr, 1066). Moreover, of all the problem solving 
strategies, it can most clearly be implemented and concretized in Logo programming. In 
Logo, small subprocedures are easily written and placed in the workspace. Because these 
can be called from anywhere in a program, a program can simply be a list of such 
subprocedures, a very concrete representation of the subgoals that maka up a 
programming solution. 



Forward chaining involves working from what Is given in a problem towards the 
problem goal in step-by-stop, transformational increments that bring one progressively 
closer to that goal. The forward chaining process can be decomposed into the following 
steps: 

1. Problem definition. Specify the problem goal. Specify what is given. 
Specify the constraints, if any. 

- 2. Trarafcfmatkxi. Use domain operators to manipulate the givens to bring 
them closer to the goal state. 

3. Evaluation. Compare the desired goal, the givens, and the 
transformation. Test to see whether the transformation is really closer to 
the goal than the givens. If it is not redo step 2. 

4. Recursion. Make the transformation a new given. Repeat steps 2 and 3 
using the new given. Continue in this manner until the goal state is 
reached and the problem is solved. 

A programming environment especially an interpreted environment like Logo, is 
inherently supportive of the forward chaining process. Transformations can be 
Implemented, their effects accessed, and successful changes instantiated as partial 
programs, wttn mauve ease ana ittoe nsx. a program can tnua oe oevetopea in 
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incremental steps and such development provide a concrete model of the forward chaining 
process. An important part of forward chaining, however, involves the ability to choose 
appropriate transformations and evaluate whether or not these actually bring one nearer 
problem solution. Forward chaining thus requires some sort of mental model of the 
problem space, and is not, therefore typically a novice technique (Qreeno & Simon, 1984). 

Systematic trial and amy 

Systematic trial and error involves the recursive testing of possible solutions in a 
systematic, guided fashion, and the problem reduction and/or refinement resulting from 
such tests. The steps involved in the systematic trial and error process include: 

1. Problem definition. Specify the problem goal. 

2. Approximate solution. Create and implement a plan to solve the 
problem. 

3. Evaluation. Compare the problem goal with the instantiated solution. If 
there are no discrepancies between them, the problem is solved. 
Otherwise, generate a description of the discrepancies between the 
desired goal and the instantiated solution. 

4. Recursion. Use the description of goal/solution discrepancies to revise 
the plan, and reapply stops 2 and 3. Continue in this manner until the 
instantiated solution matches the desired goal. 

Plaget (Qlnsburg & Opper, 1960) believed that the application of systematic trial 
and error strategies was an Important o^tormir^ctformaJoperatkxuU ability. Systematic 
trial and error, then, is an obvious candidate for testing Piperfs (1990) notion that 
programming environments support the concretizing of the formal. Certain types of 
graphics programming, moreover, are paradigmatic of systematic trial and error strategies. 
Debugging also makes use of. and provides symbolic r epresent ati ons for, such techniques 
(Carver. 1987). 

AlKpafMa. if a—a aalfcM i 

Alternative representation Involves conceptualizing a problem from differing 
perspectives. Porya (1973) writes that often the way a problem Is stated is really all that 
makes It difficult, that simple restatement will make its solution obvious. Alternative 
representation is thus the antidote to functional fixedness (Dunker, 1946). It can be 
decomposed into the following four-step description: 
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1. Problem definition. Specify the problem. 

2. Alternative representation. Generate an alternative problem 
specification 

3. Evaluation. Test to see whether the new problem specification suggests 
problem solution, if it does, solve the problem. 

4. Recursion. Otherwise, repeat steps 2 and 3 by generating and 
evaluating other problem specifications until a problem solution Is found. 

Programming is conducive to the development of alternative representations both 
because there are never single correct solutions to programming problems, and because 
differing representations can quite easily be instantiated and pragmatically tested in 
programming environments. Indeed, Clements and Quito's (1964) study of the effects of 
Logo programming on young children's cognition found significant increases in their ability 
to produce alternative representations. State's (1973) finding of significant increases on 
permutation tasks may also support this view. 

Amtatt 

Analogy involves the discovery of a particular similarity between two things 
otherwise more or less unlike, and "a mapping of knowledge from one domain (the base) 
onto another (the target) predicated on a system of relations that holds among the objects of 
both domains." (Qentner, 1967) An important factor in this process, especially in probieri 
solving contexts, is gc«l-relatedness, how one domain is like another with respect to a 
specified goal (Hotyoak & Koh, 1967). The use of analogy in problem solving can be 
decomposed into the following steps: 

1. Problem definition. Specify the desired goal. Specify the base and the 
target systems. 

2. Mapping. Perform a mapping between the base and target systems. 

3. Evaluation. Test the soundness of the match in terms of both structural 
similarity and pragmatics (goal related conditions). If the* analogy 
generated meets the goal conditions, and the structural similarity between 
the base and the target holds, the mapping is sound. Use the base 
domain solution to generate a solution in the target domain. 

4. Recursion. Otherwise, return to step 1 and specify a new base domain. 
Apply steps 2 and 3 to it Continue In this manner until an adequate 
representation Is discovered. 

ERIC § 



Programming environments inherently support the development of analogy in that 
one is always mapping between computer code (a formal representation) and program 
output (a concrete representation). Indeed, Doug Clements (1987) found significantly 
better analogical reasoning among students with prior Logo experience. 

These five problem solving strategies - subgoals formation, forward chaining, 
systematic trial and error, alternative representation, and analogy can be concretely 
represented, then, within a Logo programming context We accordingly designed our 
instruction and our testing procedures around them. The instruction was split into units, one 
tor each strategy. Each unit Included first Instruction focused on a particular strategy 
(declarative knowledge) followed by mediated practice solving problems designed to be 
particularly amenable to solutions employing that strategy (procedural knowledge). We 
likewise created six separate tests, each designed to measure students' facility in applying 
specific strategies to non-computing problems. Our goal was for students to transfer the 
strategies learned in the intervention to the paper and pencil tasks of the problem solving 
tests. 

MBOTOQOIOQy 

Subjects were one hundred students in the fourth through sbrth grades of a private 
suburban elementary school. All subjects had at least one year (thirty hours) prior 
experience programming in Logo. 

rroceouro 

All subjects were pre-tested on their ability to solve problems requiring the use of 
each of the five problem solving strategies under investigation, and randomly assigned by 
grade to one of throe treatnmrt conditions -a Lop 

maripulallves condition, or a discovery learning, Logo projects condition. Students in the 
first two conditions received the same basic problem solving Instruction but differing 
practice environments. Students In the Logo graphics group received practice problems 
Involving Logo graphics programfnlng, white students in the cut-paper manlpulatJves group 
worked on similar problems involving the use of cut-paper manlpulatJves. Students in the 
third, Logo projects group received Logo programming problems to work on, but did not 
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receive direct problem solving instruction. 

All subjects were post-tested upon completion of the intervention using different but 
analogous problem solving strategy tests. Differences between pre- and post-test scores 
were examined using analysis of variance with repeated measures. Indeperdent variables 
were tart, strategy, and treatment group. The dependent variables were the scores on the 
tests of each of the problem solving strategies. A more complete description of these tests 
and of each of the three treatment conditions follows. 

MS 

Problem solving strategy tests consisted of sets cA paper and pencil problems 
whose solutions required correct application of the particular strategies being investigated. 
Two different but analogous versions of each test were developed and randomly assigned 
by condition on the pre-test Students were then assigned the alternative fbnn of each test 
on the post-test They were allowed as much time as they left they needed to complete 
each test, but were required to work iixlependentty with no help from either the teachers or 
their peers. 

auttOMfclMMlgn (Figure 1) Our measure of students' subgoals formation 
ability consisted of mathematical word problems that required decomposition for correct 
soiirtioa Students vereasjgednctortiyto&ctotheproblere 
them into parts, and were given credit for correctly identified subgoals, as well as forth* 
correct answer. 

EstWBisbatiBQt (Figure 2) The test designed to measure subjects' forward 
chaining skins was a paper-and-pencll version of the computer program Rodo/s Bods 
(The Learning Company, 1982). In Rooky's Boots, symbolic and, or, and not gates are 
combined to produce machines that respond to targeted attributes and sets of attributes (eg. 
blue diamonds, crosses or green circles, etc.). Combinations of gates must be built up in a 
forward chaining manner to achieve correct solutions. Our version had subjects draw the 
required connections. 

nyatwmaUr trial and error. (Figure 3) Cryptography involves systematically trying 
and testing different symbol combinations to attain coherent decoding systems, we choose 
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two decoding exercises to test subjects' ability to systematically utilize trial and error 
strategies. The first of these was a shifted alphabet code. The second involved variations 
on a number code problem from Newell and Simon (1971). 
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AHamatiw a p fJMMtotiPli (Figure 4) The measure of students' ability to create 
alternative representations we used was defined from the figures subtest of the Torrance 
Teat of Creative Thinking (Torrance, 1972). Students were given sets of either parallel lines 
or circles and asked to use these as a basis for producing as many interesting and unusual 
drawings as they could. These were scored for quantity, diversity, originality, and 
elaboration. 

Anjfagy. (Figure 5) Subjects' skill at analogical reasoning was measured with 
completion exercises comprised of items representing both verbal and visual analogy. 
They were given one analogy and asked to complete a second according to the 
relationship involved in the former. 

TEMtDDBOt 

All subjects in all groups worked in pairs during their regular computer classes. A 
teacher and/or an intern were available for help on all problems. Both maintained a 
mediated learning approach toward student assistance, eliciting student and/or modeling 
their own cognitive processes as they guided students toward problem solution. Student 
pairs also helped each other solve problems. In general, classes met for two forty-five 
minute periods each week. The entire intervention took approximately two and one half 
months. 

Direct instruction in each of the particular problem solving strategies wus given to 
students in the Logo graphics and cut paper manipulatives conditions and were exactly the 
same for both groups. Wail charts based on the task analyses c4 the problem solving 
strategies but translated into children's language were made and used to introduce each 
strategy unit Figure 6, tor example, shows the chart for forward chaining. For each unit, the 
appropriate chart was produced and each step of the strategy explained and discussed . An 
example of how the strategy might be applied to help solve a problem was given and 
student examples elicited. The chart was then hung on the wall, problem sets distributed, 
and work on them begun. 
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FORWARD CHAINING 

1. What Is (he problem? 
What Is (he problem goal? 
What Is given in (he problem? 

2. How can you change what Is given so it is 
more like the goal? 

Try II. 

3. Is it really closer to the goal? 
If not, redo step 2. 

4. If it is, make your change (he new problem 
given. Go to steps 2 and 3 and redo for the 
new given. When the given matches the goal, 
you are done. 



Students in the Logo graphics condition were given unit Problem sets comprised of 
tour graphics programming problems each and asked to solve them in Logo. Students in 
the cut-paper manlpulatlves condition were given unit sets comprised of four cut-paper 
manipuiativas problems each, and provided with construction paper, rulers, scissors, and 
rubber cement with which to solve them. The purpose of the problems was to provide a 
practice environment In which students could evolve procedural representations of the 
problem solving strategies being taught Thus, problems in each set were designed to be 
particularly amenable to solutions involving the use of the strategy under discussion, and 
difficult enough to be a genuine problem. Whenever possible, similar p;obtems were used 
in both conditions. Figures 7, 8, and 9, for example, showsubgoats formation problems for 
both conditions. 
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Figure 7 

SUBCOALS FORMATION - GRAPHICS 

L Housfe 

Puf together a TR1ANGU end c SQUAXE procedure to drew a HOUSE. 

2. Neighborhood 

Put together many HOUSES to draw a NEIGHBORHOOD. 

3. Sailboat 

Use f TKlANGlE and e HALF.CJXCIE procedure to draw f 5A/lBOAr. 

4. f<ct. 

Put together ocriout thopes of your own choosing to draw * FACE. 

figun£ 

SU3GOALS FORMATION - I 

Cut' a frtanj/t and « Npwr* out e/ ewufrvcfto* *ap«r. Put rtoa taptfer f makt 
a Jiotw. P<uf# your mum htrt. 



#»■ Ji rm it ■!■ Mil mtA n i ■ • - - 



SUBGOALS FORMATION * 2 

Ma** many houses from triangles and squares. Paste them together here to make a 
neighborhood* 
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In some cases, however, the use of problems with similar surface features would 
result in highly disparate degrees of cognitive difficulty. The Logo graphics problems In the 
unit on systematic trial and error, for example, had students perform a variety of screen 
formatting activities - drawing a double border around the screen, a target, an aerial view 
of city blocks, and a house plan - which required the testing and refining of Logo 
procedures. Such activities could be done much easier with cut paper. Pentamino puzzles 
which likewise required the testing and refining of possible solutions, but were of similar 
cognitive difficulty, were therefore substituted. 

For each problem they solved, students in both groups were required to fill out a 
problem solving worksheet that showed the givers, the goal, and the solutkx^ steps for ttiat 
problem. Figures 10 and 11 show examples of completed worksheets. Students in the 
Logo graphics condition were also required to turn in a listing and a run of their programs. 
Students in the cut-paper manipulatives condition were required to turn in their completed 
designs. 

Students in the Logo projects condition were not given direct problem solving 
strategy instruction and were not required to fill in problem solving worksheets. They 
worked on Logo programming projects they s ele ct ed from lists covering four areas of 
programming concepts - procedures, variables, conditionals, and recursion. Projects 
involved both graphics and list manipulation problems and were chosen to represent the 
range of projec t s typically assigned In Logo classes. Examples of these are given In 
Figures 12 and 13. Studerta in this condition were required to work on one or more project 
from each list, progressing through the lists at their own speed and as time allowed. Their 
projects could be as simple or as complex, and utilize whatever programming and/or 
problem solving strategies they desired. Just lite students in the Logo graphics condition, 
students In the Logo projects condition were required to turn In a listing and a run of their 
programs. 

■3 
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ProotamaoMnowortshBatta 

Loop qrapHcs condition 
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Protects dea ling with procedures: 
Logo protects caond Won 



LOGO PROJECTS 

1. Write procedures Uiat draw regular shapes. Put the shapes together 
in a superprocedure that draws a picture or a design. 

2. Write procedures that draw the parts of a face (i.e. EYE, LIPS, 
NOSE, EAR). Put them together in a superprocedure that draws a 
FACE. 

3. Write a procedure that PRINTS a poem. Include it in a 
superprocedure that illustrates your poem. 

4. Write procedures that draw all the letters in your name. Put them 
together in a superprocedure that writes your name on the screen. 

S Write a superprocedure that humorously illustrate* an idiom (i.e. 
"His head was in the clouds'. "You drive me up a wall"), delude 
animation in your idiom illustration. 

6. Write a supeiprocedure that draws a sign or a poster. Use letters 
and drawing in it. 



0 0 
20 



ERIC 



Figure 13 
Pmfacfa inwotwing variabtes: 
Log) projects condition 



PROJECTS WITH VARIABLES 

1. Write procedures to draw variable sized shapes. 

2. Write procedures to draw variable sized shapes filled with whatever 
color the person wants. 

3. Write a procedure that writes a name the person types in all over 
the screen. 

4. Write a MADL1BS procedure that asks the person to type in various 
words (i.e. an adjective, a name, a place, a verb, etc) and then prints 
out a fiuuiy story using those words. 

5. Write a procedure that draws a variable-sized house. 

6. Write procedures to create a variable sized alphabet. 
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Students were tested before and after treatment on measures of each of the five 
problem solving skills. Two different but analogous versions of each test were developed. 
Students were randomly assigned one or the other version of each test by condition on the 
pre-test, and then were given the alternative version of each test on the post-test to assure 
pre- to post-test reliability. Mean pre-test scores were compared between groups using 
one-way analysis of variance and found to be statistically equivalent ^2,97 - 0.33, p > .10), 
hence the groups were assumed to be generally equal in problem solving ability before 
treatment 

Raw scores on ail tests except those for alternative representation were converted 
to percent correct scores and compared using three-way analysis of variance with repeated 
measures, Because they had no maximum possible scores and so no percentage correct 
could be calculated for them, alternative representation measures were evaluated 
separately using two-way analysis of variance with repeated measures. 



The results of the various analyses argue that explicit instruction and nrwdiated 
Logo programming practice is superior to both similar instruction with cut-paper 
manipulatJves practice, and discovery learning within Logo programming domains for 
supporting the aquisitJon and transfer of subgoals formation, forward chaining, systematic 
trial and error, and analogy strategies. Within this context. It appears that such combination 
Is most supportive of the teaching and lesjnirKJ of subgoals fomtatta 
students in the age groups studied. Results involving the teaching and teeming of 
alternative rep res e ntati on strategies were more problematical and require further 
investigation. 



Means and standard deviations for the three-way analysis of variance comparing 
scores on measures of subgoals formation, forward chaining, systematic trial and error, and 
analogy are given in Tables 1 and 2. The resulting ANOVA table is shown in Table 3. 
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swaawnatic trial and amy (STB, and analogy (AflAJ ) 



GRAPHICS CUT-PAPER PROJECTS (TXS) 





PRE 


44.0 


35.6 


29.0 


36.0 




POST 


63.1 


41.8 


28.4 


43.9 


EC 


PRE 


58.9 


51.5 


55.6 


55.3 




POST 


65.9 


46.1 


50.7 


54.0 


SIE 


PRE 


36.8 


20.6 


26.5 


27.8 




POST 


48.1 


17.5 


26.0 


30.3 


ANAL 


PRE 


78.9 


75.8 


81.5 


78.8 




POST 


86.1 


75.5 


79.5 


80.3 


(GROUP)* 




60.2 


45.5 


47.1 


50.8 
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GRAPHICS CUT-PAPER PROJECTS 

SSL PRE 22.5 22.1 24.5 

POST 22.5 29.7 25.8 

EC PRE 18.1 15.2 18.8 

POST 17.0 15.8 20.6 

SIE PRE 25.0 27.7 27.9 

POST 21.8 27.4 272 

ANAL PRE 11.4 14.1 12.4 

POST 8.6 14.5 16.0 
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33907.5 


2 


16953.7 


12.81 


0.000 


ERROR 


128357.9 


97 


1323.3 
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1 col 




4 

1 


1 578.6 


5.94 


0.0 1 66 


TQ 


6871.7 


2 


3437.3 


12.96 


0.0000 


ERROR 


2S72S.0 


97 


2652 






STRATEGY 


283190.9 


3 


94397.0 


207.11 


0.0000 


SG 


13478.5 


6 


2246.4 


4.93 


0.0001 


ERROR 


132630.9 


97 


455.8 






TS 


2274.2 


3 


758.1 


3.64 


0.0132 


TSG 


743.4 


6 


123.9 


0.6 


0.7338 


ERROR 


60640.8 


97 


206.0 







The ind epe n dent variables in the research design were test, strategy, and 
treatment group. The dependent variables were the scores on the tests of each of the tour 
problem solving strategies submitted for analysis. There was one between-subjects factor, 
treatment group, andtoowRNMubtacbfactore^ Significant main effects 

were found tor all these factors (group, ?2,97 ■ 12.81, p < .01; test, Fi,g7 - 5.94, p < .05; 
strategy, F^gj - 207.1 1, p < .01), indicating significant differences along all these 
dimensions. Of these, only the group effect is particularly meaningful. Because the groups 
were statistically equivalent before, but not after receiving the Interventions, the group effect 
indicates differences in scores resulting from treatment This result favors the Logo graphics 
condition which had an overall mean score of 60.2 percent conectcompaied with the 
cut-paper manipulatives group whose mean score was 45.5 percent correct, and the Logo 
projects group whose mean score was 47.1 percent correct 



pour arnerent wsreceon enects were also examined dv tnis design. 
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Significant tort fay grauft (F2,97 - 12.96, p< .01), tost by strategy (F3,g7 - 3.64, p < .05), and 
strategy by group (Fs,97 - 207.1 1 . p < .01 ) interactions were found. No tost by strategy by 
group interaction was discovered (p > .10). 

The interaction of greatest interest is test by group. It indicates differences in 
pre- to post-test changes in scores resulting from the differing treatments. The tests by group 
interaction was examined in greater detail by assessing the simple tost effects at each level 
of group. A strong test effect was found for the Logo graphics group (F-j g7 - 29.95, P < .01 ), 
Indicating significant pre- to post-test changes among students receiving that treatment, but 
not for the other two groups (p> .10). Table 4 shows the mean differences between pre- 
and post-test scores by group and strategy. Marginal group means reveal that students in 
the Logo graphics group improved an average of 11.1 percentage points on the four 
measures, while the scores of students in the cut-paper manlpulatJves group remained 
essentially the same, and the scores of students in the Logo projects group actually declined 
slightly (although not significantly). These results argue strongly that the Logo graphics 
intervention, and the Lego graphics intervention alone, resulted in improvements in 
students' problem solving abilities. It is interesting to note that mean pre- to post-test 
increases among students receiving the Logo graphics treatment were nearly identical to 
those observed in our pilot research indicating a consistent treatment effect, and adding 
support to conclusions arguing for the efficacy of the intervention. 
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PROJECTS 


(STRATEGY) 


SG 


19.1 


6.0 


-0.6 


7.9 


FC 


7.0 


-6.4 


-4.9 


-1.3 


STE 


11.3 


-5.4 


-0.5 


2.5 


ANAL 


72 


-3.1 


-2.0 


1.5 


(GROUP) 


11.1 


■0.7 


-2.0 


2.7 



Because the various problem solving strategy measures were not designed to be 
equivalent, the two interaction effects involving the strategy dimension are not necessarily 
meaningful. The test by strategy interaction is the more interesting of the two. It indicates 
that students had greater pre- to post-test changes on certain strategy measures than on 
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others, but, because the measures were not equivalent, any comparison of mean 
differences across strategies is problematical. Looking at the mean differences table with 
this in mind, notice that students showed by far the greatest increases on subgoals formation 
tests, and that part of the reason for this Is that students in the Logo graphics group improved 
on these measures, whereas neither they, nor students in the Logo projects group improved 
on any of the others. An examination of the simple lest affect at each level of strategy 
reveals that indeed subgoals formation measures were the only ones on which the majority 
of students exhibited significant pre- to post-test differences (F Si g7 ■ 11.59, p < .01) Such 
findings at least suggest that subgoals formation strategies were more easily acquired by 
students in this age group, a finding which concurs with the results of our pilot research. 

The strategy by group interaction indicating differing scores relative to students in 
other groups on differing strategy measures. Were thos measures equivalent, or were 
patterns of differences found on the pre-test radically different from overall patterns, then the 
differing efficacies of particular treatments for supporting the acquisition and transfer of 
specific strategies could be argued. Neither, however, was the case. The result, then, is 
significant but not meaningful. 



The tests of students' ability Id create alternative representations had no maximum 
possible correct Total scores on these tests ranged from a low of 21 to highs of over 250 
points, thus the variance on this measure was very large. The problem was compounded by 
the facts that students in all groups shewed improvements on this measure, and that a 
comparison of pre-test group means reveals they were not statistically equivalent (^2,97 " 
4.90, p < .01), hence that the groups were equal in alternative representational ability before 
treatment Means and standard deviations of raw scores on these tests are given in Tables 
5 and 6. The analysis of variance for alternative representation la given in Table 7. 



Table 7 



MaamTabtefbr 




PRE 



GRAPHICS CUT-PAPER PROJECTS 
70.7 108.2 83.3 



(TEST) 
86.8 



POST 



109,1 



123.1 



94.9 



108.7 



(GROUP) 



89.9 



114.7 



89.9 



97.8 




TabteB 

Standard Dartafcns fa r sfcrnsftis representa tio n 

ORAPHICS CUT-PAPER PROJECTS 
PRE 30.2 58.3 46.0 

POST 43.4 53.9 53.5 



ANOVATabtefbraHamliyampw 

a* -ioo) 

SS.DE MS. E E 

MEAN 1913250.6 1 1913250.6 563.36 0.0000 

GROUP 28058.5 2 14029.3 4.13 0.0000 
ERROR 329431.8 97 3396.2 

TEST 24819.1 1 2481 ?.1 10.56 0.0016 

TQ 6631.9 2 3315.9 2.57 0.0621 
ERROR 125363.8 97 1292.4 



The analysis of variance for tests of alternative representation reveals significant 
meta effects tor group (F^ - 4.13; p < .06) and tsst(F 1|9 7 - 19.20; p < .01). Neither of 
these are particularly meaningful in themselves. The group effect is not meaningful because 
the groups were not equivalent to begin with. The test effect does indicate significant overall 
pre- to post-test differences, but the means table reveals that students In all groups Improved 
on this measure. Because all groups showed improvments, what is not and cannot be 
loiown is whether such increases represent genuine learning or are rather the result of 
practice ancvbr maturation. 

What would be meaningful would be a solid tests by group interaction effect 
UrifortunatBiy the analysis of variance reveals only weak interaction (F^gz - 2.57; .06>p< 
.10). To examine the test by group interaction in greater detail, the simple test effect was 
assessed at each level of group. A strong test effect was found for the Logo graphics group 
(F 1t97 - 18.91; p < .01), whereas only a weak test effect was found for the cut-paper 
manipulatfves group (F«| ,97 - 3.81 , .05 > p < .10), and no test effect at all was found for the 
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Logo projects group (Fi ,37 « 1 .81 ; p > .10). It is interesting to note that these results mirror 
the findings for subgoals formation and perhaps indicate that direct instruction was a more 
significant factor in the success of the intervention than Logo programming, although both 
appear necessary for transfer to take place. 

These differences are illustrated by Figure 14 which shows the mean pre- to 
post-test differences for each group on alternative representation measures. It can be seen 
that the Logo graphics group showed improvements nearly twice as great as those of the 
group with the next highest improvements, the cut-paper manipulatives group. However, 
because students in the Logo graphics group had much lower pre-test scores than students 
in the other two groups, the greater gains they made might be accounted for by differential 
ability levels as well as by treatment effects. The most we can conclude, then, is that it is 
possible that students in the Logo graphics group showed an increased facility for 
alternative representation, and that such possibility argues for further investigation with more 
evenly matched groups. 



EtaumJi 

Mean scores tor aUsmatfw rapwwnngdton by tra^ nent groups 




PRE- TEST POST-TEST 
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Discussion 



in terms of our research questions, we Can conclude that direct instrucnon wis 
more effective than discovery learning in supporting the acquisition and transfer of problem 
solving skills from Logo programming to non-computing domains, and that the Logo 
programming envrionment was an improtant factor in such acquisition and transfer. The 
results argue quite strongly, then, for the superiority of direct instruction and mediated Logo 
programming practice over both similar instruction with cut-paper manipulattves practice, 
and discovery learning in similar paractice environments, for the acquisition and transfer of 
four problem solving strategies - subgoals formation, forward chaining, systematic trial and 
error, and analogy - among middle school students. Indications are that such instruction 
and practice may likewise be most effective for the teaching and learning of alternative 
representation measures, although further research with more evenly matched groups is 
needed to determine its effectiveness in this area. 

Such findings argue that the intervention we designed does, in fact, support the 
teaching and learning of problem solving, that increased scores on problem solving strategy 
measures resulted from it and not from the effects of practice and/or maturation. They also 
lend support to our analysis of the Logo/problem solving literature, in that direct instruction 
and mediated programming practice resulted in students' acquisition and transfer of 
problem solving skills whereas Logo programming practice atone did not Indeed, 
indications are that direct instruction may be a more important factor than Logo 
programming in the success of the intervention we designed. Both factors, however, appear 
necessary, as students in the group receiving direct Instruction with cut-paper manipulatives 
practice fared little better than students in the Logo discovery group. 

Two issues raised by the research results deserve further comment The involve the 
efficacy of knowledge-based instructional design for the teaching and learning of problem 
solving, and the mediation*! nature of computer programming environments, the Logo 
programming environment in particular. 

Knowledge-based instructional design refers to premising the design of instruction 
on desired knowledge outcomes rather than on desired behaviroal outcomes. The 
distinction is a real one. The desired outcome of problem solving instruction, tor example, is 
increased problem solving abilities. When such abilities are conceived in terms of desired 
behaviors, they are understood as being able to solve particular kinds of problems and are 
not broken down any further because they are not conceptualized beyond this behavioral 
level. Problem solving ability to seen as its behavioral manifestation, hence, the prescribed 



31 29 



instruction has correspondingly involved practice solving such problems. Little emphasis is 
<, placed on the general knowledge structures which underlie their solution, and the 

particulars of specific strategies are not addressed. This sort of instruction, especially in the 
context of computer programming, has not been successful in increasing students' problem 
solving abilities (Abbott, Salter & Soioway, 1986; Shaw, 1968; Patterson & Smith, 1986; 
Mandinach & Linn, 1987). They are not successful because complex cognitive behaviors 
like problem solving involve more than their manifest behaviors and must be addressed at a 
deeper level, at the level of the knowledge structures which support such behaviors. 

Indeed when one conceives of problem solving instruction in terms of knowledge 
outcomes, the desired outcome is understood as the knowledge necessary to solve 
particular kinds of problems. The focus is not on the behavior but on the knowledge 
supporting the behavior. The knowledge supporting problem solving behvtors is the 
procedural knowledge of the specific steps involved in particular problem solving strategies. 
That such knowledge underlies problem solving has been demonstrated by problem solving 
computer programs (Newell & Simon, 1972; Anderson, 1983). Moreover, such knowledge 
has a declarative as well as a procedural component (Anderson, 1966; Flavetl, 1986). At 
least in the case of the instruction we designed, a direct locus on a declarative knowledge of 
the steps involved in the particular problem solving strategies was a necessary factor in the 
success of the intervention. Because it focuses on behaviors and not knowledge, 
behvatorally-based instructional design ignores this important, perhaps critical, declarative 
knowledge component 

Knowledge-based instructional design played a critical role in the success of the 
instructional model we developed. It may well be a more useful approach to the design of 
problem solving instruction in general, perhaps to the design of any instruction concerned 
with complex cognitive behaviors. It clearly deserves further carefui study. 

The mediations! nature of computing environ m ent s refers to the way in which 
computers can be used to support what Papert (1980) refers to as "transitional objects to 
think with." Papert maintains that computing environments can support quasi-concrete, 
dynamic representations of abstract ideas, representation that can be manipulated and 
tested and which provide Immediate concrete feedback concerning the soundness of their 
formulation. Such representations are transitional in that they can help bridge the gap 
between condrete and formal thought They are mediations! in that they support abstract 
thinking which might otherwise overwhelm working memory. 

Such a view is supported by the finding that students given direct problem solving 
instruction and mediated practice in a non-computing onvrionment did not learn the problem 

solving otratogioe ae well ae did etudento given similar dlrea* instruction and mediated Logo 
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practice. Lehrer and Rand la's work (1967) also suggests such a view. If computing 
environments can be designed to support such transitional objects for thinking, they might 
play an important role In education. The notion certainly deserves further investigation. 



The development of problem solving and critical thinking skills is a erucdai problem 
for education today. The research presented in this paper clearly demonstrates a successful 
model for developing particular problem solving abilities among upper elementary student 
populations, a model which, in itself, deserves further study. More importantly, it suggest 
methods for designing Instruction that might develop such skills in a broad range of subject 
area contexts, in particular, knowledge-based instructional design and the mediational use 
of computing environments. In today's educational climate, such methods deserve 
immediate serious attention. 
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